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A State-Dependent Updating Period For 
Certified Real-Time Model Predictive Control 

Mazen Alamir 


Abstract —In this paper, a state-dependent control updating 
period framework is proposed that leads to real-time im- 
plementable Model Predictive Control with certified practical 
stability results and constraints satisfaction. The scheme is 
illustrated and validated using new certification bound that is 
derived in the case where the Fast Gradient iteration is used 
through a penalty method to solve generally constrained convex 
optimization problems. Both the certification bound computation 
and its use in the state-dependent updating period framework are 
illustrated in the particular case of linear MFC. An illustrative 
example Involving a chain of four Integrators is used to show 
the explicit computation of the state-dependent control updating 
scheme. 

Index Terms —MFC, Certification, Real-time, Stability. 

I. Introduction 

Modern control paradigms such as Model Predictive 
Control Col, Moving-Horizon Observers m or adaptive 
identification of varying models m to cite but few 
issues involve the real-time, on-line solution of constrained 
optimization problems. In such applications, the output 
of the optimizer (namely the sub-optimal solution of the 
optimization problem) is fed to some neighboring modules 
in order to achieve some engineering tasks. The quality of 
the global task may strongly depend on the quality of the 
sub-optimal solution and the frequency with which it can be 
updated by the optimizer and since this solution has to be 
delivered in finite and probably short time, it is important to 
be able to precisely link the quality of the suboptimal solution 
to the available computation time for a predefined embedded 
computation power. When the latter is not yet defined, such 
insight enables to choose the appropriate computational power 
given the required quality of the sub-optimal solution. 

The last few years witnessed an increasing interest in the 
certification issue m, a, 0. These almost simultaneous 
works proposed certification bounds for fast gradient-based 
iterations CD, ina applied to Quadratic Programming (QP) 
problems involving only simple constraints that enable easy 
projection on the admissible set. Otherwise, the iterations 
that are needed to perform the projection have to be counted 
as well and certified with some associated lower bounds 
which would invalidate the relevance of the proposed bounds. 

It is not surprising that recent certification-related results 
concerned fast gradient-based iterations. This is because 
the simplicity of this iteration and the associated low 
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computational cost have been rapidly identified as appealing 
properties in the real-time context which is the very reason 
for which certification results were required. 

Regarding the other alternatives, active set iterations M, 
while computationally efficient and while showing a provably 
finite number of iterations to converge (for QP problems), 
seem to resist to the derivation of convergence rates which 
makes impossible the computation of certification bounds. As 
for interior point methods 121, ifTsl . H, certification bounds 
exist HD but seem to be systematically over pessimistic 
m. Nevertheless, for many problems, it might still be more 
appropriate to use these efficient although uncertified or 
pessimistically certified algorithms rather than to use a slow 
certified iterations. The right choice is problem-dependent. 

The first part of this paper belongs to the family of 
works that address the derivation of certification bounds 
for fast gradient-based iterations in the presence of general 
constraints. This is motivated by the nice properties 
mentioned above, namely the reduced complexity of the 
single associated iteration that enables the use of extremely 
short updating period. As it has been recently shown 121, 
0, 0, this last property may compensate the drawback 
of potentially higher number of iterations when compared 
to some alternative methods, especially in uncertain context 
(which includes perfectly known systems under unpredictable 
set-point dynamics). In such situations, as underlined by 
HD, it is important to distinguish between the concepts of 
analytical complexity which involves only the number of 
iterations (regardless of their inherent computational cost) 
and the arithmetical complexity which accounts for the total 
number of elementary operations until convergence which 
is obviously the appropriate indicator in real-time context 
and this is precisely why fast gradient is an interesting option. 

The second part of the paper proposes a general framework 
to explicitly account for the arithmetical complexity by 
including the computation time for a single iteration in the 
overall convergence analysis and trade-off handling. This 
feature if absent from recent works on the certification issue 
such as Cl where the number of iteration is induced from 
the required precision on the solution and the corresponding 
number of iteration is derived as a consequence. This 
argumentation suggests that provided that one uses sufficiently 
high number of iterations, convergence of the real-time MFC 
will be guaranteed. This paper shows that this argument 
is generically erroneous and that in realistic situations, the 
appropriate updating period shows lower and upper bounds 
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beyond which stability can no more be guaranteed. 

More precisely, the contribution of the present paper 
lies in the following items: 

1) it gives a certification bound for the fast gradient 
algorithm when applied to solve a general (not necessarily 
simple bounded) convex optimization problems by means 
of a penalty approach. The number of iterations needed to 
achieve a prescribed level of precision on the optimal cost 
and a prescribed level of precision on the satisfaction of the 
soft constraints (while the hard constraints are fully satisfied) 
is given as a function of the problem’s characteristics. 

2) it shows how the certification bound so obtained can 
be used in the framework of real-time MFC in order to 
assess the practical asymptotic stability of the closed-loop 
performance under a state-dependent control updating period. 
The latter is computed based on some key properties of the 
MFC formulation. This second part while using the results of 
the first part has a general scope and can be applied to any 
available algorithm with computable certification bound. 

This paper is organized as follows: Section |II] defines 
the class of optimization problems addressed in the paper 
together with the associated definitions and notation. Section 
Un] states the working assumptions and gives some preliminary 
results that are used in the next sections. The algorithm and 
the associated certification bounds are presented in section HVl 
with instantiation to the specific case of QF problems. The use 
of the certification bounds in real-time MFC implementation 
through state-dependent control updating period is proposed 
in section E and the concrete computation of the parameters 
involved in the expressions is shown for the specific case of 
linear MFC. Finally, the whole scheme is illustrated through 
the MFC-based tracking problem for a quadruple integrators 
under state and control constraints. For the sake of clarity, all 
the technical proofs are gathered in appendix lAl except those 
that can be given in few words. 

II. Froblem Statement 

Consider the following optimization problem in the decision 
variable p: 

min /o(p) I Ci(p) < 0 Vj S 4 U /« := {1,..., nd (1) 

pgR"? 

where 4 and 4 are the disjoint subsets of ric} that 

define a partition of the set of constraints into soft and hard 
constraints respectively, /o(-) is the cost to be minimized 
while Ci : R"p —R. defines the i-th inequality constraint. 
Note that saturation constraints on p are supposed to be 
included in the set of inequality constraints. It is assumed 
that /o and Ci are differentiable for all i. 

The algorithm proposed in this paper invokes the following 
penalty induced augmented cost: 

( 2 ) 


where p is called the penalty parameter while ip : R"!” —>■ R_|_ 
is the constraints induced cost given by: 

V’(f) := X! [™ax{0,Cz(p)}]^ -f ^ [max{0, c^{p) + 
ieit, ieih 

For a given paire e := {eo,e^) of strictly positive reals, a 
candidate value p is called an e-suboptimal solution of O if 
the following two conditions hold: 

\fo{p) - < £0 and ip{p) < (3) 

where denotes the optimal value of ([T]i. 

The relevance of the second constraint in @ lies in 
the fact that when satisfied, this constraint implies that all the 
hard constraints are rigorously satisfied while the maximum 
violation of any soft constraint is lower than e^. 

The first aim of the present paper is to derive the necessary 
relations that enable for a given precision e to choose the 
appropriate penalty coefficient p and the stopping condition 
for the fast gradient iteration to be used in the unconstrained 
minimization of the cost function / defined by (|2]i. Moreover, 
the bound on the minimum number of iterations that 
guarantees an e-suboptimal solution to the original problem 
is derived. This is done in sections |III]and|IV] 

The second aim is to show that this certification result 
(or any similar one for possibly another algorithm) can then 
be used to design a real-time constrained MFC implementation 
in which a state-dependent control updating period is used to 
yield certified convergence properties. This is done in section 

E 

The results are proved in a rather general convex settings 
and for both goals, the expressions enabling the parameters 
involved in the statements of the results to be computed are 
explicitly given in the specific case of QF problems and 
linear MFC design. 

III. Assumptions and preliminary results 
A. Definitions and Notation 

In what follows, / (p), /q(p) and {p) denote the gradients 
of the functions w.r.t the decision variable p. The euclidien 
norm of / (p) is denoted by g{p) = ||/ (p)||. For a scalar 
continuously differentiable function i defined on R", the 
notation i G states that £ is a p-strongly convex function, 
namely for all (pi,P 2 ): 

KP2) > £{.Pl) + (/(pi),P2 -Fl) + ^\\P2-PlV (4) 

where p is called the convexity parameter of i ns. Similarly, 
the notation i G indicates that the continuously differen¬ 
tiable function i satisfies for all (pi,p 2 ): 

^(F2) < 4fi) + (^'(Fi),F 2 -Fi) + ■^I1 f 2 -Fif (5) 

When £ satisfies both @-0, the notation £ G 5^ ^ is used. 
The set C denotes the set of singular points of /(■), namely 


/(f) := /o(f) + F X fiip) 
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the set of p such that g{p) = 0. Given a subset A C R"*’, the 
notation d{p, A) refers to the distance from p to A, namely 
d{p,A) := min^g^ ||z—p||. The short notation d{p) := d{p,C) 
is used for the specific set C. The set is the set of p 

such that ipip) = 0- Given a bounded subset P, Jp denote 
the radius of P namely := sup^^,^ ,j, 2 )gp 2 ||a;i — X 2 \\- For a 
compact set X, the notation p(X) denotes the maximum norm 
of elements in X, namely p(X) := sup^gx ll^^ll- 

B. Working Assumptions 

Assumption 3.1: The cost function value /o(p) is 
nonnegative for all p. 

This assumption can be made satisfied by adding sufficiently 
high positive constant. It is quite common in MFC context 
where the cost function refers quite often to the integral of the 
tracking error that is added to some positive terminal term. 

Assumption 3.2: There are two reals Lq > 0 and > 0 
such that fo G and ip G 


holds for all p. <C> 

The expressions of the parameters Lq, L^, /tq, Dq and /3 in 
the specific case of quadratic cost /o and affine in p constraints 
Ci are given in section ITV-CI 

C. Preliminary results 

In this section some preliminary results are stated. For better 
readability, all the proofs are given in the appendix. The first 
result gives a property of the gradient of /□ at the stationary 
point p*\ 

Lemma 3.1: The following inequality holds 

II/o(f*)II < ^0 (9) 

Proof. See Appendix lAl 

The following result characterizes the behavior of the 
penalty term ip in terms of the penalty coefficient p: 

Lemma 3.2: If p > Lq/ jd then the following inequality; 


Assumption 3.3: There is po > 0 such that /o G 
Moreover, T' is convex. 

Note that this assumption implies that / G and that there 
is a unique critical point for / which is denoted hereafter by 
p* G C. therefore according to the definition of d{p), one has 
dip) := \\p-p*\\. 

In what follows, the notation and pa refer to two 
vectors such that: 

Pu ■■= min /o(p) ; ipipa) < 0 ( 6 ) 

p6R!> 

namely, pu is the unconstrained minimum of /o while pa is 
any admissible point. Having pa, the following definition can 
be stated since /g is supposed to be continuously differentiable 
and because /g G 5^^ [Assumption 13.31 : 

Definition 3.1: Define Dq by: 

Dq := sup ||/o(p)|| > 0 ( 7 ) 

/o(p)</o(Pa) 

Remark 3.1: In fact, the knowledge of the admissible point 
Pa is only required to compute Dq. therefore, if an upper 
bound of Dq can be found, the knowledge of pa is not 
mandatory. This is clearly shown in section ITV-Cl in the specific 
case of QP problems [see inequality (l23t l . This is crucial since 
in the MFC context the constraints are state dependent and it 
may become cumbersome to compute pa for each current state. 


V’(p) < ^ dip) + 


kq 

VpJ 


1 2 


where kq := 


2Lr 


— i’ipu) 
do 


( 10 ) 


holds for all p. In particular, for p* one has: 

^ip*)<^ (11) 

2p 

Proof See Appendix iBl 

Note that Lemma 13.21 quantifies how increasing p leads 
to a smaller constraint violation depending on the amount of 
violation ipipu) at the unconstrained minimum of /g. 

The following corollary gives a bound on the difference in 
the cost /g evaluated at the unconstrained optimum p* of 
f = fo + pip and the true optimal cost as a function of 
constraint violation: 


Lemma 3.3: Let p°P* be the optimal solution of the orig¬ 
inal problem ([TJ. p* the unconstrained minimum of /. The 
following inequality holds: 


l/o(p°^‘) - /o(p*)l < Do 


'ipij}*)' 

Lq 

'ipip*)' 

[ p \ 

+ 2 

[ P \ 


Proof. See Appendix ICl 


( 12 ) 


Using Lemma [33] one can prove the following result; 


The next assumption concerns the behavior of the penalty map 
outside the admissible set. 


Assumption 3.4: There is /3 > 0 such that the following 
inequality: 


ipip) > /3 X 


2 


dip,Ap^Q) 


( 8 ) 


Corollary 1: If the following inequality holds: 


/3 . 


<^i(e) := 


Dq 

Lq 



- 1 


then the stationary solution p* satisfies; 


l/o(p°^‘)-/o(p*)|<e 


(13) 


( 14 ) 
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Proof. This can be easily obtained after noticing that the 
r.h.s of (fTSl i is a second order polynomial in y/tp{p*)/l3. 
Writing that this polynomial is equal to e and solving for it 
gives the result. □ 

Note however that p* is never reached exactly. Instead, 
the fast gradient iteration will be used to reach an iterate 
p that is close to p*. Now since the available certification 
bounds on the fast gradient iterations concern the guaranteed 
value of \f{p*) — f{p)\ while the e-suboptimality is defined 
in terms of the original cost /o, the following lemma gives a 
link between these two indicators; 


Lemma 3.4: The following implication holds for all e: 

{\f{p) - fiP*) \ ^ ^ 

-/o(p*)|<^o 


Po 


Lq 

2 


Mo 


} 


(15) 


Proof. See Appendix iDl 


Here again, Lemma 13.41 gives the condition on the precision 
ei required on / in order to induce a precision €2 on /o, 
namely: 


Algorithm 1 [pN,qN,aN] = F^^'>{po,qo,ao) 

1 

for i = 1 : N do 


2 

p,+i ^ qi- f'{qi)/L 


3 

Compute tti+i G (0,1) solution of = (1 — 


+MoQ!i+i/L 


4 

Pi ■«- {apl - cti)) /(a| 

+ Cti+l) 

5 

Qi+l 'L- Pi+l + Pi{pi+1 

-Pi) 

6 

end for 



Proposition 4.1: (' ifTSll . page 80) The successive iterates of 
Algorithm [T] starting from the initial guess pq, ag = y/po/L 
and qo = po satisfy the following inequality: 

f{p^) - f{P*) < 

X min|(l-c)*,-^^--ji^| X ||po-p*f (18) 

where c := p^/L and where p* stands for the unconstrained 
minium of /. <C> 

The following is a direct consequence of Proposition 14.11 

Corollary 3: If the initial guess satisfies ||po “ P*ll ^ ^ 
then for any e > 0 , the integer: 


Corollary 2: If p is such that \ f{p) — f{p*)\ < ei with 
1 

' < Zi{e2) (16) 

where Zi is the function defined by (fTSl l then, one has |/o(p) — 
/o(p*)l < £ 2 - 


Mo 


«(c,7) ;= max - 1))} (19) 

where 7 := 2 e/((L -f po)S^) ; c = \/po/L 

is an upper bound of the number of iterations N needed by 
Algorithm [T] to deliver a sub-optimal solution pjv satisfying 

IHpn)- fip*)\<e. <> 


Proof. Use the same arguments as before since the r.h.s of 
(fTSl l involves the same polynomial as in (fT^ . □ 

The certification bound of the fast gradient needs an 
upper bound on the distance between the initial guess p and 
the minimizer of /, namely p*. The following lemma gives 
such an upper bound in terms of the value of the function / 
at the initial guess p: 


Proof. Inject ||po —p*\\ < <5 in (fTsT i and impose that the r.h.s 
is < e. □ 

Now using the bound on ||po ~P*|| ^ r(po) given by (fTTI i. 
the following result follows: 

Corollary 4: Given any initial value po, let 70 := 

epo/[{L -I- Mo)/(Po)] then N{c,jo) is an upper bound of the 
number of iterations N needed by Algorithm [T] to deliver a 
sub-optimal solution p^ satisfying |/(pAr) — /(p*)| < e. <C> 


Lemma 3.5: The following inequality is satisfied for all p: 

'V{p)' ’ 


lb* -pII < 


Mo 


=: r(p) 


(17) 


Proof. This is a direct consequence of the inclusion / G 5^^ 
and the fact that /o (and hence /) is positive. □ 


IV. The Algorithm 

A. Recalls on the Fast Gradient iteration 

The fast gradient algorithm proposed in m is commonly 
used to perform unconstrained minimization of a function / G 
It is briefly recalled through Algorithm [T] for which the 
following convergence result holds 


B. The Proposed Algorithm 

The proposed algorithm involves the quantities defined by 
(l 20 l i- d 2 lTi that depend on: 

• the problem’s intrinsic properties {pQ, Lq, /3, Dq) 

• the unconstrained solution-dependent parameter kq [see 

(dOj] 

• the desired precision pair e := (eo,s^) 


Pi 

P2 := 


Ki 


2 

0 


LiJjKq 


2^Zf{eol2) 


( 20 ) 


p3 Lq/P 


^ MO ^ 2 /to, 


r}2 : = 


2 

4:Lil, 


( 21 ) 
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These quantities are used in Algorithm |2] below; 


Proposition 4.3; Provided that the set of inequalities Ap < 
B implies the condition p G P, the following inequality holds; 


Algorithm 2 p* = A{po,e := {eo,e^)) 

1: ao = {po/L)^, qo :=po 
2: p = max{pi,p2,P3} 

3: p = m in{77i ,?72} 

4: c = ^/po/L 

5: 70 = VPo/j{L + Po)fo{po)] 

6 ; AljYiax — 

"7; 9min — P 0 '\/^q~/L 

8: again=true 
9: while (again) do 

10 : [pi+i,qi+i,ai+i] = FG^'^\pi,qi,ai) 

11: if [{i > Nmax) OT {g{pi) < Pmin)] then 

12 : again=0 

13: else 

14: i = i -\-l 

15: end if 

16 : end while 

17: p* = p. 


Do< [Xmax{H)]-p+\\F\\ (23) 


where 


P 

in which 

/: 

Proof. See 

Assumption 13.41 is satisfied with /3 ;= <Tmin{A) which 
is the lowest non zero singular value of the constraints 
matrix A. The coefficient kq involved in lemma 13.21 and the 
expressions (l20l l- (l2Tl l used to compute p and p is obtained 
using the values of Lq, P, po and pu mentioned above. 


\\F\\ + ^\\F\\^ + 2X^UH) [/] 


^min (H) 


(24) 


= lXmax{H) [p(P)] V ||F|| . P(P) 

Appendix |F] 


(25) 


The following result gives a certification bound on the 
number of iterations needed by Algorithm |2] to achieve an 
e-suboptimal solution of the original problem. 

Proposition 4.2: Let be given a precision pair s := 
(£ro,e^), an initial guess po- Let 70 ;= ppo/[{L + Po)fo{Po)] 
where p ;= min{ 77 i,p 2 } with the yy^s given by (l2lT i. The 
algorithm in which p = max{pi, p 2 , Pa} is used with the p^s 
defined by (l 20 l i involves at most N{c^^q) unconstrained fast 
gradient elementary iterations before it delivers an estimate 
p* that is an e-suboptimal solution of the original constrained 
optimization problem O- 

Proof. See Appendix |E] 

In the remainder of the paper, the maximum number of 
iterations that guarantee the precision as expressed in 
Proposition 14.21 is denoted by; 

N{pq, £ 0 , £^) ;= iV(c, 70 ) (22) 

as the arguments of N completely determine c and 79 . 


Numerical experiments In order to check the validity 
of the certification bound N(pQ,eQ,£^), 500 random QP 
problems have been generated with n = 10 decision variables 
and ric = 20 constraints. More precisely, H ;= + crl 

is used where C G and a G 1], F and sq has 

been computed so that the cost is \\p — p^Wj^ + 1 where 
is randomly generated. The constraints matrices A G 
and B G has been randomly generated so that a feasible 
solution exists. The precision = 10“^ has been used while 
£q has been systematically taken equal to 1% of the true 
optimal cost that is obtained by QUADPROG-Matlab solver. 
The initial guess is systematically taken equal to 0 as one 
might use in cold start MPC context. 

The results are shown in Figure [T] where the histogram 
over the 500 trials of the ratio between the effectively 
needed number of iterations N and the maximal computed 
certification bound Nmax (step 6 of Algorithm 2) is plotted. 
The results suggest that for this class of QP problems, the 
bounds is not that conservative and that since some scenarios 
lead to a ratio between 0.5 and 0.6, as far as certification is 
needed, it cannot be strongly reduced. 


C. Case of Quadratic Programming (QP) problems 

Here, the expressions of Lq, L^, po, Dq and /3 are given in 
the specific case of QP problems where the cost function and 
the constraints take the form; 

fo{p) = ^P^Hp + F'^p + So ; Ci{p) = A^p - B, 

In this case. Assuming that Sq is such that assumption 13.11 
holds, it is straightforward that Assumptions 13.21 and 13. 3l holds 
with Lq = Xmaxi^lf L^jj = CJ'maxiA') and Pq = Xmini^dl'). 
Moreover, one has pu ;= —H~^F. Now according to remark 
13.11 Pa is not needed provided that an upper bound for Dq 
can be derived. This is the aim of the following proposition; 


V. Application to Real-Time MPC 

In this section, it is assumed that a certification bound 
N{pq,£q,£^) is given for some algorithm. Based on such a 
bound, a real-time MPC implementation framework is pro¬ 
posed using a state-dependent control updating period leading 
to provable practical convergence. It is therefore important to 
underline that the results of this section does not necessarily 
relate to the use of the fast-gradient algorithm as they can 
apply to any algorithm for which a certification can be asso¬ 
ciated that depends on the initial guess pq and some required 
precision pair (eq and £^) in the sense of (O. 
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N/Nmax 

Fig. 1. Histogram showing the statistics of the ratio N/Nmax between the 
effectively needed number of iterations N and the certification bound Nmax 
computed from the theory when using the numerical experiments described 
in section li^ 

A. Definition, notation and working assumptions 

In this section, a set of assumptions are stated. Not all of 
them are used in all the subsequent results. That is why in 
the statement of each result, the assumptions that are needed 
are explicitly mentioned. 

In MFC framework, the controller disposes of a model 
of the form 

X = F{x, u) {x, w) e M” X (26) 

where the following assumption is used regarding the dehni- 
tion of the vector x: 

Assumption 5.1: The state vector x involved in ( |26] | gath¬ 
ers the physical state of the system together with the current 
set-point and current estimation of the disturbance. The model 
also incorporates the assumption on the future behavior of 
these exogenous variables. 

We consider that the future control prohles are parametrized 
through a hnite dimensional vector p of degrees of freedom 
such that at each instant t, the future prohle depends on p{t) 
according to: 

u{t + s)-.= U{s,p{t)) s€[ 0 ,T] (27) 

where U is some predehned map and T is the prediction 
horizon. 

Since the MFC has to be computed based on the prediction 
of the future state (in the sense of Assumption 15.11 1. the 
following assumption is needed to characterize the state 
prediction error: 

Assumption 5.2: For each compact set C to which belongs 
the pair {p{t),x{t)), the prediction x{t + T) of the future state 
starting from x{t) and under the control prohle U{-,p{t)) can 
be affected by an error satisfying 

||a;(f -I- r) - a;(f -I- r) II < E^x t (28) 

Note that E^ in (l28T l accommodates for unpredictable 


set-point changes while E^ accommodates for the presence 
of disturbances that affects the input of some integrator in 
the system or for the presence of unpredictable time-varying 
set-point. 

The cost function is dehned at instant t based on the 
knowledge of the state x{t) (including the current value of 
the set point and the disturbance estimation and prediction). 
This leads to a constrained optimization problem of the form 
([T]i in which both /o and Ci are dependent on the current 
value x{t) of the state, namely: 

fo{p,x{t)) ; 'fi{p,x{t)) 

Consequently, the call of Algorithm as well as the bound 
(I22I 1 on the number of iterations must now incorporate the 
state x{t) as an argument, namely: 

p* = A{po,eo,e^,x) ; N{po,eo,e^,x) (29) 

In order to use the results of the preceding section, one needs 
to assume that for all x, there are positive reals Lo{x), L^{x) 
and j3{x) and a strictly positive plq{x) > 0 that play the 
roles of Lq, L^, P and ptQ as defined in the preceding section. 

Now if for some reasons, one knows that the pair {po,x) 
involved in (|29] | belongs to some compact set C := P x X, 
then one can obtain a certification bound that depends only 
on the precision parameters e := namely: 

Nc{£o,£,p) ■= max N{p,£q,£^,x) (30) 

(p,a:)£C 

Moreover, the following result shows that the bound 
iVc(eo, £,/>) can be computed through static optimization steps 
involving the functions /o and -fi: 

Proposition 5.1: Let a compact set C := P x X be given, 
the bound Nc{eo, dehned by (l30l l can be computed by the 
following steps: 

1) Compute according to: 

:= max|-!/'(p«,a:) | fo{pu,x) = o| (31) 

2) Compute Lq, as the maximum of Lq{x) and L^{x) 
over X G 'K 

3) Compute and po as the minimums of P{x) and plq{x) 
over X S X 

4) Compute := 

5) Compute using (l20l l in which replaces kq 

6) Compute := min{77i,p2} where the pi are com¬ 

puted by (l2Tli in which replaces p. 

7) Compute := fo{p, x) 

8) Compute 7^^“ := -f /ro)/(r“'"] 

9) Compute := a/ 

Finally compute the desired quantity: 

Vc(eo,£,A) (32) 

where N is dehned by (fT9] l. 

Proof. Straightforward as the computation systematically 
takes the worst case towards the increase of N. □ 
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In section IV-CI Explicit computation of all the quantities 
involved in Proposition 15.11 is given for the specific case of 
state-dependent QP optimization problems that arise in the 
linear MPC context. 

It is also assumed that the cost function /o is proper in 
both p and x in the following sense: 



Dc 


Assumption 5.3: For any positive real </) > 0, there is a 
compact set such that the following implication holds: 

|/o(p,a;) < </>} ^ |(p,a:) e C^l (33) 

Regarding the dependence of /o and -0 on x, the following 
assumption is considered: 


Assumption 5.4: For any compact set C, there are positive 
real K^, > 0 such that : 

||/o(p,a;i) - /o(p, 2:2)11 < Kl ■ ||a:i - X 2 \\ (34) 

\\tp(p,xi) - '0(p,X2)|| < ■ llxi - X 2 II (35) 

for all (p, xi), (p, X2) e C. 


A typical formulation of /o(p, xq) in MPC is given by: 

/o(p,xo) := n{x{T,p,Xo))+ £{x{s,p,Xo),p,s)ds 


Jo 


=: r2(x(T,p,xo))-f [ £{s,p,xo)ds (36) 

Jo 

where x(s,p, xq) is the predicted state value at instant s 
starting from xq at instant 0. 


Fig. 2. Illustration of Assumption 15.61 


Regarding the penalty function £, the following assumption is 
used: 

Assumption 5.6: [Figure |3 For any compact set C, there 
is a positive real Dc > 0 and a positive function q{-) such 
that : 


£{s,p,x) > max {0,q{x) — Dcs} (38) 

for all (p, x) € C. 

Note that condition ( l38l l simply states that with bounded 
control, there is a limitation on the speed with which the 
state can be steered to the desired region. With this respect, 
q{x) is simply a state dependent term in £ that expresses 
how far does x lie from the desired region. This notation 
enables many situations to be handled as x includes set-point 
definition and therefore, mesures of the difference between 
the physical state of the system and their desired value can 
take the simple form expressed by q{x). 


Regarding the formulation of the MPC, the following 
(commonly satisfied) assumption is needed in the sequel: 

Assumption 5.5: The MPC formulation is based on a cost 
function of the form ( |36] | with the necessary constraints that 
make the following inequality satisfied: 

/o(p°^‘(f+ 'r),x(<-f r)) - fo{p°^\t),x{t)) < 

< — A(t, x(f)) := — f £{s,p°^*{t),x{t))ds (37) 

JO 

where p°P*{t) is the optimal solution of the problem defined 
for the state x{t) while p°P*{t -f r) is the optimal solution 
of the problem defined by the predicted future state x{t -\- t) 
starting from x{t) under the optimal control 14 {■, p°P*(t)) that 
is applied on the interval [t, t + t]. 

Note that p°f* (f) does not appear as an argument of A since 
p°P*{t) is assumed to be uniquely determined by x{t). 

Remark 5.1: Note that the inequality (ITtT i is satisfied only 
for the ideal predicted future state x{t-\-T) since otherwise the 
bad knowledge of uncertainties and/or the set-point changes 
may invalidate the inequality if the true value x{t-\- t) of the 
state is used. 

Remark 5.2: Note that inequality (iTTl i is commonly sat¬ 
isfied in the standard provably stable MPC formulations. 
Moreover, the r.h.s A(t, x(f)) is generally exhibited through 
the corresponding stability proof (see Qol). 


Finally, the following assumption is used to characterize the 
available computational facility: 

Assumption 5.7: The system is controlled with a compu¬ 
tational facility that performs a single elementary iteration of 
the fast gradient (step 9 of Algorithm |2|l in Tc time units. 

Note that if another certified algorithm than the fast gradient is 
used, Tc used hereafter denotes the time necessary to perform 
a single iteration of that specific algorithm. 

B. Certified MPC by state-dependent updating period 

Assume that a scheme is based on the iterative on-line 
definition of a sequence of updating instants and a sequence 
of precision parameters denoted by: 

tk+i=tk + Tk ; (39) 

which are linked through the definition of the updating periods 
Tfe according to: 

Tfc := Tc X (40) 

where C is some compact subset of x MP and Tc is the 
computation time needed for a single fast gradient iteration 
(see Assumption I5.71 i. 







rc('r, g) 


More precisely, given the current state x{tk) and a control 
that is applied during the sampling period 
[tk,tk+i], Algorithm |2] is used to compute the control 
parameter p*{tk+i) (that is to be applied during the next 
sampling period) with the hot start and the 

precision parameters Note that by the very 

definition (|40] | of r^, the value of the control parameter 
p*{tk+i) that is obtained by Algorithm |2] before tk+i 
necessarily meets the precision requirements, namely: 


qVi^Dc) 



q/Dc 


T 


Fig. 3. Evolution of rc(T, g) involved in Lemma (5^ 


foip*{tk+l),x(tk+l)) - foip°^\tk+l),x{tk+l)) < 
Ci{p*itk+i),xitk+i)) <0 i&h (41) 

Ci(p*(ffe+i),i(ffe+i)) < i G Is 

Using the first inequality, one can prove the following result: 

Lemma 5.1: If the following conditions hold 

1) Tfe is defined by (|40] | for some compact set C := P x X 

2) For all k, [p*(ffc)]+^'' G P 

3) For all k, x{tk) G X 

4) Assumptions 15.2115.41 and 15.51 are satisfied 
then the following inequality holds for all k: 

foip*{tk+l),x{tk+l)) - foip*itk),x{tk)) < 

Eq ^ + K^{E^ + E^Tk) + Eq ^ — A.{Tk, x(tk))(4-2) 

Proof. See Appendix iGl 

Note that the term /o(p*(ffe), a;(ffc)) represents the value of 
the cost function at the effectively visited pairs {p{tk),x{tk)). 
Therefore, the difference expressed in the l.h.s of (l42T i 
is relevant for the stability assessment of the resulted 
truncated MPC implementation. On the other hand, using the 
definition ( l40l l of r^, the r.h.s of (l42l l can be viewed as a 
function of the precision pair The stability 

issue is therefore dependent on the possibility to define 
these precision parameters in such a way that the r.h.s of 
(l42l l is negative. This is the aim of the following development. 

Since the only negative term in the r.h.s of (l42T l is 
—A{Tk,x{tk)), we need a lower bound on A{Tk,x{tk)). The 
following straightforward lemma gives such a lower bound: 


Decrease condition 



Fig. 4. Typical evolution of the quantities involved in the r.h.s of equation 
ED invoked in corollary [5] The decrease of the cost function is possible if 
there is a tagreted future precision sq for which the red-solid curve lies below 
the dash-dotted curve. 

Using the definition (l40l) of and the r.h.s of (|4^ in 
(l42l) the following computable function can be defined: 

Sip, q) ■= Kci^C + fcEc^i^O, Sip)) +£o~ 
I'ciTc- Niso,epj),q) (45) 


Lemma 5.2: If the following conditions hold: 

1) iP*{tk),x(tk)) G C 

2) Assumption 15.61 is satisfied 

then a computable lower bound of the quantity A(r, x(ffc)) 
can be obtained by: 

A{T,x{tk)) >Tc{T,q{x{tk)) (43) 

where rc(r, g) is given by (see Figure O: 

[ qr - ^Dct"^ if t < q/Dc 
Tc{T,q)-.= l ^ (44) 

—— otherwise 

I 2Dc 

Proof. See Appendix iHl 


so that the following corollary of Lemma ISTI can be stated: 


Corollary 5: If the following conditions hold 

1) The requirements of Lemma O are satisfied 

2) Assumption 15.61 holds 

3) q{x(tk)) > q 

then the following inequality holds 


fo{p*(tk+l),x{tk+l)) - /o(p*(ffc),x(ffc)) < 
Sq + RtASq ,S^ ,q) 


(46) 


where Rr^{-) is defined by (|45]) . 


Figure |4] presents a typical situation showing that for a given 

(k) 

past achieved precision Eq , a given computational power 
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leading to the computation time Tc and a given precision 
on the soft constraints satisfaction, either there is no 
making the r.h.s of equation (05]) invoked in corollary |5] 
negative or there is an interval of successful values of 
which does not contain 0 and which depends on the current 
value of q{x{tk)) = q- 

Note that corollary |5] involves quantities that depend on some 
compact set to which belong all the pair {[p*, x{tk+i)- 
Using assumr)tion l5.31 it is possible to prove that such compact 
set is linked to a set of initial conditions for which a certified 
convergence result can be derived for the resulting real-time 
MPC. This is stated in the following proposition which is the 
main contribution of the paper: 


Proposition 5.2: Consider a positive real > 0 and the 
corresponding compact subset C K."*’ x R" defined 

according to assumption 15.31 Let be given a precision e^ > 0 
on the soft constraints satisfaction. 


If the following conditions hold with C = : 

1) Assumptions 15.2115.4115.51 and 15.61 are satisfied 

2 ) 3qmin > 0 and 7 c > 0 such that the inequality: 


(^0 5 — 




(47) 


admits a solution Eg°'(g) e [ 0 , 7 cg^„/( 2 £>c,^J] for all 

Q ^ Qmin 

then the truncated MPC design based on the adaptive sampling 
period defined by: 


Tfc := Tc X N{eQ°\q{x{tk)),e,p) (48) 


steers the system to the set: 

^mm C R I Pix) ^ Qmm I" 

provided that the initial condition satisfies: 


Mp*{tQ),x{to)) < (j )0 


e(0) < 


^cQrnin 


(49) 


(50) 


Moreover, if the hard constraints depend only on p, then along 
the closed-loop trajectory, one has: 

max [c,{p*{tk),x{tk))] < 0 

iGlh,k>0 

max [ci{p*{tk),x{tk))] < e^+ (51) 

iGls ,k>0 

Proof. See Appendix U 


C. Case of linear MPC 

Linear MPC formulation applies to system of the form 


i = Aqz + Bqu 


(52) 


Ud = 0 . Using the extended system with the extended state 
X = and the extended dynamic built up using ( l52l) 

with Zd = 0, one obtains the controlled system model given 
by: 

X = AsX -I- BgU (53) 

where x is an extended state containing the set-point and 
disturbance model state and where the cost function (l36l l is 
given by: 

iis,p,x) := i[g(x(s,p,a;)) -f ||W(s,p)|||] (54) 

where q{x) is given by: 

q{x) = \\z - ZdWq ■■= \\Cx\\l^ (55) 

The control parametrization map U{-,p) used in (|56j) gives 
the control profile over the prediction horizon as a function 
of the finite dimensional parameter vector p. 

This formulation leads to state-dependent QP where the 
cost function and the constraints are given by: 

fo{p, x) = ^p'^Hp + {Fix)'^p + x'^Sx (56) 

Ap < B^°'> -f B^^'>x (57) 

It results that the definition of Lq, and /io remains 
unchanged since these parameters depends only on the state 
independent quantities H and A. 

It is also assumed that the formulation involves appropriate 
final constraints such that dJTl) of Assumption 15.51 holds with 
A(t,x) satisfying: 

A{t,x) > f q{x{s,p°^*,x))ds (58) 

Jo 

This can be obtained through appropriate final equality 
constraints that can be explicitly embedded in the control 
parametrization map U{-,p) or through softened final 
inequality constraints as suggested in M- 


Given a set of interest X, the upper bound on Dq defined by 
(|2^ - (|25]) can be used provided that ||F|| is replaced by 


sup||i^ia;|l < IlL’ill X p(X) (59) 

ccGX 

The computation of invoked in dSTT t of proposition 15.11 

is obtained according to: 


^max 


max 

xGX 


ric 

(max{ 0 , MiX — Li})^ 

.j=i 


(60) 


where 


M, := 

u ■■= 


Bf^ 


in order to stabilize the physical state 2 : around some desired 
value Zd- We assume for the sake of simplicity that Zd is a 
steady state for (|52| that corresponds to the steady control 


where Aj and b\^'’ denote the i-th line of A and B^^^ 
respectively. Note that the optimization problems (|60l) can 
be computed once for all using available NLP solvers for a 
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beforehand given sets of interest P and X. 

Once '0™“^ is computed, the resulting involved 

in Proposition 15 .1 1 iitem (4)] can be computed and used in the 
computation of Finally, the parameter involved 

in Proposition 15. II is computed according to: 


P X X, the constants and involved in ( l34l) and (l35l l of 
Assumption 15.41 can be given by: 

K ■■= IIF/’II X p(P) + 2A„a,(5) X p(X) (65) 

( 66 ) 

where is computed by dbOl) . 


rmax ._ 

Jo •— 


max 

(p,x)ePx 



which admits the upper bound: 

fr" < [>^ma.{W)] X max ||zf 

zGPxX 

— ^max {W) X p(P X X) 

It remains to give explicit computation of Dc in OSI of 
Assumption 15.61 This is given by the following proposition: 


Proof. See Appendix iKl 

The only remaining parameters are and E^- involved in 
(1281 ) of Assumption 15.21 and which describe the prediction 
error on the extended state a; as a function of t. Note that 
if the model is perfectly known, the only prediction error 
comes from the fact that the future evolution of the set-point 
Zd is unknown. Two cases can be distinguished: 

• If the set point if filtered, then 

= 0 and = maxt(||id(f)||) (67) 


Proposition 5.3: If the constraints p € P implies that 
U{s,p) G U for some compact set U, then the following 
expression of Dc meets the requirement of Assumption 15.61 

Dc = >^maxiQ) X p(X) X [||A^|lp(X) + ||Bs||p(U)] (61) 

Proof. Compute the derivative of ||C'a;(s,p, x)||q (which 
takes the values q{x) at s = 0) and derive a lower bound on 
the speed with which this term may converge to 0 given the 
compact set to which belongs the arguments x and p. □ 


• Otherwise 

E^ = g{Zd) and E^ = maxt(||id(f)||) (68) 

In case other sources of prediction errors prevail, then 
an additional positive term ei has to be added so that 
E^ = maxt(||id(f)||) + ei is used. 

1) Illustrative example: MFC control of a chain of integra¬ 
tors: Let us consider MPC control of a chain of n integrators 
given by: 


The next result concerns the explicit derivation of the 
compact set given an initial cost function level f as 
described in Assumption |53] This is the aim of the following 
result: 

Proposition 5.4: If The possible set points Zd belong to a 
compact set Zd, then given f, the compact set involved 
in (1^ of Assumption 15.31 is given by := P x X where: 

P := |p s.t IIpII < [(/)/A™n(Wo)]" I (62) 

X := |x s.t ||x|| < p(Zd) + [^/Ami„(tTo)]" |(63) 


Zi = Zi+i for i = 1,... ,n - 1 (69) 

Zn = u under \u\ < u = 10 (70) 


in which the objective is to track a reference trajectory on zi 
under the state constraints: 





(71) 


using the formulation of section IV-CI This is obviously a 
very important sub-class of systems that is heavily used in 
Mechatronics. 


where Wo is the matrix given by: 


Wo = 

f H 

Fii\ 

(64) 



where Fu G 

and 

Sn G 

are the z- 


corresponding sub-matrices of Fi and S involved in (l56l l 
respectively. 

Proof See Appendix U 

Once the compact set is computed for a given initial value 
(j> of the cost function, the constants and involved in 
(l34l i and dTSl l of Assumption 15.41 can be explicitly computed 
using the following proposition: 

Proposition 5.5: For the cost function /q defined by (|5^ 
and the constraints defined by (fSTl) . given a compact set C := 


We consider a parametrization of the form: 

Uis,Puit)) = [<I>uis)]puit) ; (72) 

in which a final constraint on the state is imposed: 

\\ziT) - ZdW = Cx{T) = 0 (73) 

By doing this, the stability of the ideal perfect scheme is 
guaranteed with Assumption |53] satisfied. The final constraint 
satisfaction can be imposed through the reduced parametriza¬ 
tion: 

Pu = Kp-\-MxQ (74) 

where the matrices K and M depend on the function basis 
involved in ( IT^ and the prediction horizon T such that taking 
p = 0 always leads to p^ that satisfies the final constraint. This 
means that because of the saturation constraint (iTOl i. the final 
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constraint (|7^ can be feasible through (l74l i only for initial 
state xo such that 

\\Mx4 < u (75) 

leading to the bound ||a;o|| < (~ 11-3 in the case 

n = 4). By doing this, the number of decision variables is 
given hy Up = m — n. In the following results, the weighting 
matrices Q = and R = 0.001 are systematically used in 
(l55l l and (l56l l. A prediction horizon T = 10 is used in the 
sequel while to = 10 dimensional parametrization variable is 
used in control parametrization (l72l i. This leads to a number 
of free decision variables of dimension Up = 6 . 

The computation time for a single iteration Tc = 0.1/rs 
is used (time needed for a matrix-vector multiplication in 
Step 10 of Algorithm 2). It is supposed that the reference 
value Zd lies in the domain [—5,+5]. All the constraints are 
taken to be soft with = 10“^. The formulation of the 
problem and the choice of the constraints checking instants 
lead to a number of constraints tic = 300. 


Note that in order to check the existence of qmin satisfying 
the condition (Ezli of Proposition dH, one can check the 
existence of solution to the inequality 


(^0: ^mm) — 


'lcQ_min 

3-Dc^„ 


(76) 


since if (|7^ is satisfied for qmin in the l.h.s, it will be satisfied 
for any q > qmin used in the l.h.s while qmin is used in the 
r.h.s. An additional condition invoked in Proposition [52] states 
that this solution £q must be such that; 


^5< 




ill) 


Note also that the parameter (j>o invoked in (TT^ defines an 
upper bound on the possible initial value of the cost fo{p, x). 
Therefore, in the case of hot starts, the size of (j)o can define 
the quality of the hot start. Otherwise, one can take an upper 
bound pessimistic value (j)o by starting from p = 0 and taking 
the upper value of /o(0,a;) over the set of admissible initial 
state defined by dTSl l. namely: 


'll 

4>0 ^ ^max{S) ll^ll ("^3) 

Based on the knowledge of (po given by (fTSI l. the condition 
dSll can be checked for different candidate values of qmin- 


Figures |5] and | 6 ] shows the results for the cases n = 4 
and n = 2 respectively. More precisely. Figure |5] shows 
that for the quadruple integrator system under an unknown 
future behavior of the set-point characterized by = 0.05, 
the certification conditions (l76l l and dnii are satisfied with 
qmin = 0.36 and 7 ^ = 0.2. 


• 10-3 


Checking conditions (l76l l and (iTTl l 



£0 


Fig. 5. Check of the certification feasibility for the chain of n = 4 integrators. 
The condition (76) is satisfied by an interval of values of so including values 
satisfying il7\ . Successful values: qmin = 0.36, 7c = 0.2, = 0.05. 


7 c are used in (|76]) and (iTTl) . 

Once the lower bound qmin is computed, one can come back 
to the g-dependent certification condition ( l47l) of Proposition 
15.21 in order to compute for each q > qmin the lower bound 
£g(g) and the upper bounds £ 0 ( 7 ) of the admissible values of 
£o- 


The state dependent sampling dTSl) can therefore be defined 
by the number of iteration associated to the precision £g°* 
given by: 

£^*7) := (1 - >^)^{q{x)) + A£o(g(x)) (79) 

where A € [0.5,0.9] in order to enhance high sampling period 
(higher values of £ 0 ) while keeping some security margin. 

Figures |7] shows the corresponding evolutions of the 
bounds £ 9 ( 5 ) and £o(g) as functions of the ratio q/qmin for 
the quadruple integrator system (n = 4) studied previously. 
This Figure clearly shows that when q{x) is high, law 
precision (high values of £ 0 ) can be used. Although this is a 
known fact, the results proposed here gives a certified explicit 
computation of this feature. The Figure shows also clearly 
that attempt to achieve over-precise solution may lead to 
instability since there is a lower bounds on £ 9 . 


Figure | 6 ] shows that the certification is possible for the 
double integrator system with the unknown behavior of the 
set-point defined by = 0.3 provided that qmin = 0.18 and 


VI. Conclusion 

In this paper a certification bound on the convergence of 
the fast gradient algorithm when applied to solve convex 
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optimization problems with general inequality constraints with 
a prescribed level of sub-optimality is first given. The resulting 
bound is then used to derive a real-time implementation of 
MFC with state-dependent updating period leading to certified 
convergence of the resulting closed-loop to a neighborhood 
of the desired set-point. The proposed results clearly showed 
that the time needed to perform the elementary iteration 
is a key parameter in the resulting MFC implementation. 
To this respect, the proposed results can be used to afford 
limited computational power or to compute, for a given control 
problem and a given specification in terms of optimality and 
constraints fulfillment, the admissible computation power that 
need to be assigned. 

Appendix 

A. Proof of Lemma 13.71 

This comes from the fact that p* is the unconstrained 
optimum of / which means that; 

fo{P*) + PlPiP*) < foiPa) + f{Pa) = foiPa) (80) 

and since 'tjj{p*) > 0, the last inequality gives fo{p*) < 
fo{Pa)- The inequality to be proved is therefore a simple 
consequence of the definition 13. II of Dq. □ 


Fig. 6. Check of the certification feasibility for the chain of n = 2 integrators. 
The condition ED is satisfied by an interval of values of sq including values 
satisfying 1771 . Successful values: qmin = 0.18, 7c = 0.2, = 0.3. 


B. Proof of Lemma 13.21 

Let us denote by p^ the closest element of A,p=o to p*. 
The triangular inequality implies: 


\\p-p^p\\ < \\p-P*\\+ \\p* - P^W < d{p)+ \\p* - p^W 

( 81 ) 


eg(a;), £o(a^) and eQ°\x) 



Fig. 7. Quadruple integrator: Evolution of the bounding values £o(9(^)) 
£o(q(^)) and a possible state dependent precision £q°^{x) defined by ED- 


and because ip € : 


ip{p) < ip(p4,) + {ip ip^),p-p^) + ^\\P-P,p\f (82) 

but since p^ G A^=o, one has that ip{p^) = 0 and ip (p^) = 0 
[because of the particular structure of the penalty], therefore 
dS^ becomes (because of dsTT i'): 


P^ip) < ^ 


dip) + \\p* -Pv>ll 


1 2 


(83) 


It remains to prove that the term \\p* — p,jj\\ can be bounded 
so that the inequality (ITOl) holds. Note that since p* minimizes 
/, one has: 


/o(FV') + Pi’iP^p) > foiP*) + pipip*) 
and since ip{ptp) = 0 the last inequality leads to: 

b(F*) < -[foiPi;) - foiP*)] (84) 

< k\\foiPl\\-\\P*-Pi^\\ + ^\\P*-Pi^f¥5) 

P ^ 

Now let pu be the unconstrained minimizer of /o, namely 
foipu) = 0. Note that p„ is uniquely defined since po > Oby 
assumption. Now by definition of p* and pu, one has: 


Mp*) + Pf{P*) < foiPu) + pipiPu) 


( 86 ) 
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on the other hand. 


fo{p*) > foiPu) + ylb* - PuW^ (87) 

By combining (IMll-®, it comes that: 

lb* -Pu\\ < \/—'>Pipu) 

V Mo 

This with the Lypschitz induced inequality gives; 

Wfoip*) - 0|l < LoWp* -Pu\\ < LoJ—ip{pu) =: Kovb 

V Mo 

where := Lq^J2iI){ jpu)/ po.This last inequality together 
with (l85l l implies: 

< -[^ovblb* -M 1 /-II + ^Ib* (88) 

p ^ 

Now using ® in which d{p*,A^=o) = lb* “PV’II gives: 

/3|b* -Pv-ll^ ^ -['^ovblb* -MV'II + ^\\p* 
p ^ 

and after straightforward manipulations, it comes that; 


P- 


2p 


Ib*-Wll<^ 


Now assuming that p> Lq/ fi, one obtains; 


(89) 


D. Proof of Lemma 13,41 

Assume that for some p the following inequality hold; 


\f{p) - f{P*)\ < e 
this means that (/ £ 5^0 )• 

1 

ib-pii< [-!' 

.Mo. 

on the other hand; 

l/o(p) - /o(p*)l < -Do|b-M*ll + ylb-M*f 
this together with ( l94l i gives the result. 


(93) 


(94) 


(95) 

□ 


E. Proof of Proposition 14.21 

Proof. We shall first prove that when the algorithm stops, 
one has; 

l/(p*)-/(p*)l <M (96) 

then we prove that when ( |96] | holds then p* is an £-suboptimal 
solution of the original problem. To prove ( |96] ). we shall 
distinguish two situations depending on the exit condition of 
step 10. Indeed, either g{pi) < gmin '■= Po in which 

case (|96] | is satisfied since / £ Or the algorithm stops 

after N{c,-fo) iterations where 70 := gpo/[{L + po)fo{po)] 
which implies ( |9^ by virtue of Corollary |4l 

We shall now prove that when (l96b holds, one necessarily 
has: 


PVp PVp 

which together with (l83]) clearly ends the proof since the in¬ 
equality (fTTI) is a direct consequence of the fact that d{p *) = 0 
by definition. □ 


C. Proof of Lemma 13.31 

Since pp is admissible and p°P* is the optimal solution of 
the constrained problem, one necessarily has: 

/o(p“^‘) < Mpp) (90) 

Moreover, since /q £ the following inequality holds: 


b(r) < 4 (97) 


l/ob*) - /ob°^‘)| < £0 
Proof of Tpip*) < 

By the /XQ-strong convexity of /, equation (|96] | implies that 

lb* ~ P*\\ ^ \/(2/Mo)m- Injecting this in (fTOl) gives; 

_ 2 

2 m ^ kq 

MO vb. 


b(p*) < ^ 


So in order to prove that ip{p*) < e^, it is sufficient to prove 
the following two inequalities: 


^ and ^ 

V Mo 2 y Lp ^J~p 2 y L^ 

But the first inequality is satisfied because p < M 2 while the 
second is satisfied because p > Pi- 


Mpp) < fo{p*) + ll/o(p*)ll • lb* -Pv-ll 
and since ||/o(p*)|| < Dq (Lemma 1X11) : 


Lq 


lb* -Pv>ll' 


fo{pp) < Mp*) + DoWp* -ppW + y lb* -PV'f (91) 

which together with (l90b and ([Hll of Assumption 13.41 gives: 
l/o(p°^‘) - /o(p*)| < Do 


Xp*)' 

Lo 

Xp*)’ 

[ P \ 

+ 2 

[ P \ 


This obviously ends the proof. 


(92) 

□ 


Proof of |/b*)-/o(p°P*)l <£o 
Using the triangular inequality: 

i/o(r)-/o(p“"*)i<i/o(p*)-/o(p*)i + 
l/o(p*)-/o(p°"‘)| 
and using (fTSl) and (fT 2 l i the last inequality gives: 


l/ob*) - /o(p°^‘)| < Do 
Do 



- X 

'X 

.Mo. 

^ 2 

.Mo. 


Xp*)' 

Lo 

Xp*)’ 

[ P \ 

+ 2 

[ P \ 
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therefore, the result can be obtained if the following inequality 
are satisfied; 


Do 

2 p 


2p 

(?!' 

VI 

(98) 


Po\ 

2 

LmoJ 

z 


* 

A- 

1 _1 

O 

" To iip{p*y 
2 . /3 _ 

< ££ 

- 2 

(99) 


The first inequality is satisfied since r] < rji while the second 
is satisfied if: 


Hp*) 

P 


2 


< ^t(|) 


( 100 ) 


But thanks to (fTTI) [satisfied since p > pa] this can be proved 
if the following inequality holds; 


2/?p - 




( 101 ) 


which is satisfied because p> P2- 


□ 


H. Proof of Lemma 15.21 

By definition of dJTb of A and using ( l38b of Assumption 
(Ell, it comes that: 


A(t, x) > / max{0, q(x) — 

Jo 


fniin{T,q{x)/Dc} 


{q{x) — Dcs)ds 


q{x)T - 


• min{r,q'(fc)/Z)c 


which can be expressed using rc(T, g) given by (l44l) . □ 


1. Proof of Proposition IQ 

The first inequality in (l50l) together with Assumption 15.31 
impliy that Corollary |5] applies with fc = 0, C = and 
q := q{x{tk)), therefore one has: 


F. Proof of Proposition I4.il 

Recall that in the specific case of QP problem, the definition 
of Do becomes 

Do := sup ||iTp+T’|| 

fo(p)<fo{Pa) 

But we have by assumption ||pa|| < Pmax, which enables to 
write: 


fo{p*{ti),x{ti)) - fo{p*{to),x{to)) < 

4°^ + -Rre(4^\ev-,4(a:(fo))) (104) 

and since = eo°‘(x(to)), if q(x(to)) > q-min the inequality 
(EUl gives: 


RrASo^^i^ydixito))) < 


^cQmin 


(105) 


foiPa) < IXmaxiH) [p(P)]^ + ||T^|| ■ p(P) + fo =■- f 

and since fo{p) > iAmi„(i4)||p|p - ||i^|l|b|| + fo, the last 
inequality implies; 

ll^ll < \\F\\ + ^\\F\\^ + 2Xm^niH)[f-fo] ^ _ 

Xmin {JJ') 

which obviously gives the results. □ 

G. Proof of Lemma 15.71 

Using Assumption 15.41 and 15.21 . it comes that: 

fo{p*i.tk+i),x{tk+i)) < fo{p*{tk+l),x{tk+l)) + 

+7Tf! X \_E£ + X Tk\ (102) 

Now by definition of r^, the solution p*(tk+i) satisfies 


and thanks to the second inequality in (l50l) . the inequality 
(fTOSl) gives: 

e^^HRrAe^^\e^,q{x{to))) < (106) 

This together with (11041) implies that /o(p*(fi),x(fi)) de¬ 
creases meaning that the new pair is still in and since 
satisfies by assumption the second inequality in (l50l) . the 
argumentation can be repeated to derive the properties of the 
next pair (p*(t 2 ), x(t 2 )) meaning that the following inequality: 


fo(p*(tk+i),x(tk+i)) - fo(p*(tk),x(tk)) < 




is satisified as far as q(x(tk)) remains grater than qmin- This 
clearly implies that x{tk) converges to the limit set Xmin 
defined by ( l49b . 


fo(p*(tk+i),x(tk+i)) < fo(p°^^(tk+l), x(tk+l)) + 

which together with Assumption 15.51 gives: 

fo(p*(tk+i),x(tk+i)) < /o(p°P‘(ffe),a:(ffc))+4^^^^ 

-A{Tk,x{tk)) 

< fo{P*{tk),x{tk)) +6^^'* 

+4^^^^ - A(rfe,x(ffc))(103) 


regarding the constraints, note that the hard constraints 
are necessarily satisfied since they depend only on p by 
assumption and that p*{tk+i) satisfies by construction the 
hard constraints while allowing only for a violation of the soft 
constraints by an amount which is lower than e^, therefore, 
one has: 

c^{p*{tk+i),x{tk+i)) < £^ yiGis (107) 


□ 


Using the last inequality in (1102b gives the result. 


which obviously gives (fSTT i by Assumptions 15.21 and 15.41 □ 
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J. Proof of Proposition 15.41 

Given Zd, one rewrite the cost function using the change of 
variable y = z — Zd enables to write the cost function (l5^ in 
the form 


fo{p,y) 



which means that if fo{p,x) < f then the following inequal¬ 
ities hold; 

Ibll < [f/\m^n{Wo)Y ; Ibll < [f/Xm^n{Wo)Y ( 108 ) 


The first inequality obviously gives (l62]) while the second leads 
to: 

Ibll < IbdII + b/Ami„(lTo)] = 

which gives (l6^ . □ 


K. Proof of Proposition 1531 

In order to prove that dhSl) satisfies (l34l i. we use the definition 
of /o to write: 

ll/ob,a;i) - /o(p, 2:2)11 = 

||(Fi(a:i -X 2 ))^p+ Ibilll- ||a: 2 ||||| 

< \\iFiP)'^ixi - 0:2)11 + 2 \max{S) X p(X) X I|xi - a: 2 || 

< [IlFi^ll X p(P) + 2 \max{S) X g(X)] ■ Ibi - 0:211 

which proves (l65T l. 

It remains to prove that defined by (l 6 ^ satisfies 

drsT l we first note that: 

ric 

^(a;) := ^ [n{p,x)f 

with ri{p, x) = maxjO, Aip — — Bjx^. Therefore; 

||g||< 2 f;h(p,x)|.||i?f^ll 

2 = 1 

and using the inequalities expressing the equivalence of the 
L 2 and Li norms, the last inequality gives: 

ric 

|r,(p,a;)p • ||(S(il)'^|| 

2=1 

2 nc [^(^,2:)] X ||(S(^ 1 )^|| 

2 n^ X X ||(S(^»'^|| 

which obviously gives (l 66 l l. □ 
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